Skip to content

Add ESM-2 protein language model#1383

Open
vincentamato wants to merge 1 commit intoml-explore:mainfrom
vincentamato:add-esm
Open

Add ESM-2 protein language model#1383
vincentamato wants to merge 1 commit intoml-explore:mainfrom
vincentamato:add-esm

Conversation

@vincentamato
Copy link

I implemented Meta AI's ESM-2 protein language model in MLX! I've included:

  • Complete ESM-2 implementation (8M to 15B parameter models)
  • HuggingFace model conversion script
  • Benchmarking scripts which show ~34% speedup over PyTorch MPS on my M4 MacBook Pro
  • Example notebooks for using the model
  • Tests validating equivalence with original implementation

The key to this is in the notebooks that guide you through using the model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant